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(54) Image processing apparatus, image processing method and storage medium 



(57) In case of managing image data among plural 
image processing apparatuses, an object of the present 
invention is to suppressor restrain, as much as possible, 
that the image data is illegally or unfairly used. In order 
to achieve the object, e.g., it is provided an image 
processing apparatus which is connected to an external 
apparatus being an output destination of the image data, 
the image processing apparatus comprises an input 



means for inputting the image data representing an im- 
age, an addition means for adding additional information 
capable ol specifying the external apparatus to the im- 
age data inputted by the input means, in a state that the 
additional information is difficult to be perceived by hu- 
man eyes, and an output means for outputting the image 
data to which the additional information was added by 
the addition means, to the external apparatus. 



CM 
< 

CO 
CM 

CO 
00 



Q. 
LU 



FIG. 4A 



PRINTER: A-1 23 



SCANNER: B-456 



0S:C 

VERSION: 789 
KEY ID: EFG 



2 



B 


C 


A 


D 



REPRODUCED IMAGE 



DISPLAY: D-0lF| 



-ft ADD-ON IN A STATE DIFFICULT 
TO BE PERCEIVED BY 
HUMAN EYES 



Prkited by Jouve, 75001 PARIS (FR) 



(Cont. next page) 



4SDOCID: < E P 0843237 A2_l_> 



EP 0 843 237 A2 



FIG. 4B 



A 


B 


c 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 


B 


C 


D 


A 



REPRODUCED IMAGE 



FIG. 4C 



A 


B 


C 




A 


B 


C 




A 


B 


C 




A 


B 


C 




A 


B 


C 


D 


A 


B 


C 


D 


A 



REPRODUCED IMAGE 



JSDOCID: <EP 0843237A2J_> 



2 



1 



EP 0 843 237 A2 



2 



Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an image process- 
ing apparatus and method which can add various infor- 
mation to an image, and to a storage medium which 
stores such the method. 

Related Background Art 

Conventionally, various technique has been devel- 
opedto suppress that a negotiable paper such as a bank is 
note or the like is forged by using a single-body image 
copy machine such as a color copy machine or the like 
to be unfairly used. 

For example, in one technique, additional informa- 
tion (e.g., machine number of copy machine) is added 
to an image which is copied and produced by such the 
color copy machine, in a state that the additional infor- 
mation is difficult to be perceived by human eyes. That 
is, since the additional information is patternized and 
then added to only an yellow component of the color im- 
age to be copied and produced, such the information 
becomes difficult to be perceived by the human eyes. 

Thus, when the illegally or unfairly formed image is 
found, it can be detected by which copy machine (i.e., 
image formation unit) such the image was copied, by 
analyzing the additional information added to the image. 

On the other hand, in addition to the problem of ne- 
gotiable paper, there is some fear that a copyright, a like- 
ness right, a trademark right or the like is infringed or 
trespassed even on an image such as a picture, a pho- 
tograph, a video, an animation character or the like. In 
such a case, the above technique is also effective. 

Further, in recent years, functions of a computer 
system and peripheral apparatuses for inputting and 
outputting image data, such as a scanner, a printer and 
the like have improved year by year. Therefore, in a case 
where image forming is performed by using such the 
plural image processing apparatuses, the high-quality 
image such as the negotiable paper or the like can be 
formed. 

Furthermore, since network technique such as an 
internet or the like has progressed, the image data can 
be transferred from one image processing apparatus to 
the another distant image processing apparatus. 

Under these circumstances, in order to prevent 
such illegal actions, it is insufficient that the image 
processing apparatus for adding the additional informa- 
tion only adds the additional information to specify of 
identify this image processing apparatus itself. This is 
because the plural image processing apparatuses 
which participated in the illegal actions can not be spec- 
ified or identified only by such the additional information. 

Furthermore, the information for specifying the ap- 



paratus itself, such as the machine number, a type 
number or the like, has been conventionally used as the 
above additional information. 



The present invention is made in consideration of 
the above-described related background art, and an ob- 
ject of thereof is to suppress or restrain, in case of man- 
aging image data among plural image processing appa- 
ratuses, that such the image data is illegally or unfairly 
used. 

An object of one aspect of the present invention is 
to add, in addition to conventional additional informa- 
tion, further-effective additional information to an input 
image in a state that the additional information is difficult 
to be perceived by human eyes. 

An object of one aspect of the present invention is 
to process, in case of outputting the image data repre- 
senting an image to an external apparatus, such the im- 
age data not to be used illegally or unfairly. 

In order to achieve the above object, according to 
one preferred embodiment of the present invention, it is 
provided an image processing apparatus which is con- 
nected to the external apparatus being an output desti- 
nation of the image data, the image processing appara- 
tus comprising: 

an input means for inputting the image data repre- 
senting the image; 

an addition means for adding the additional infor- 
mation capable of specifying or identifying the ex- 
ternal apparatus to the image data inputted by the 
input means, in a state that the additional informa- 
tion is difficult to be perceived by the human eyes; 
and 

an output means for outputting the image data to 
which the additional information was added by the 
addition means, to the external apparatus. 

An object of one aspect of the present invention is 
to process, in case of inputting the image data from an 
image pickup apparatus capable of generating the im- 
age data by reading the image, such the image data not 
to be used illegally or unfairly. 

In order to achieve the above object, according to 
one preferred embodiment of the present invention, it is 
provided an image processing apparatus which is con- 
nected to the image pickup apparatus for generating the 
image data by reading the image, the image processing 
apparatus comprising: 

an input means for inputting the image data from 
the image pickup apparatus; 
an addition means for adding the additional infor- 
mation capable of specifying or identifying the im- 
age pickup apparatus to the image data inputted by 
the input means, in the state that the additional in- 
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formation is difficult to be perceived by the human 
eyes; and 

an output means for outputting the image data to 
which the additional information was added by the 
addition means. 

An object of one aspect of the present invention is 
to suppress or restrain the illegal use of the image data 
by not adding such information specifying the apparatus 
itself as in the related background art but adding another 
additional information. 

In order to achieve the above object, according to 
one preferred embodiment of the present invention, it is 
provided an image processing apparatus which oper- 
ates by using a predetermined software, the apparatus 
comprising: 

an input means for inputting the image data repre- 
senting the image; 

an addition means for adding the additional infor- 
mation capable of specifying or identifying the pre- 
determined software to the image data inputted by 
the input means, in the state that the additional in- 
formation is difficult to be perceived by the human 
eyes; and 

an output means for outputting the image data to 
which the additional information was added by the 
addition means. 

An object of one aspect of the present invention is 
to further suppress or restrain the illegal use of the im- 
age data by not adding such the information specifying 
the apparatus itself as in the related background art but 
adding another additional information. 

In order to achieve the above object, according to 
one preferred embodiment of the present invention, it is 
provided an image processing apparatus which is con- 
nected to the external apparatus, the image processing 
apparatus comprising: 

an input means for inputting the image data; 
a color process means for performing a color proc- 
ess on the image data inputted by the input means, 
in a method suitable for the external apparatus; 
an addition means for adding a code specifying or 
identifying the method of the color process to the 
image data, in a state that the code is difficult to be 
perceived by the human eyes; and 
an output means for outputting the image data to 
which the code was added by the addition means. 

The above and other objects, features, and advan- 
tages of the present invention will be apparent from the 
detailed description and the appended claims in con- 
junction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an entire image 
process system used in a present embodiment; 
5 Fig. 2 is a detailed block diagram for explaining 
structure of Fig. 1 ; 

Fig. 3 is a view showing an original image which is 
read and inputted by a scanner in the present em- 
bodiment; 

10 Figs. 4A, 4B and 4C are views showing a concept 
of a reproduction image formed in the present em- 
bodiment; 

Fig. 5 is a flow chart showing a series of processes 
by a printer driver; 
75 Fig. 6 is a view showing an example of a description 
form of a color profile; 

Fig. 7 is a view showing an additional pattern gen- 
eration method used in an add-on process; 
Fig. 8 is a view showing one add-on line existing in 
each of areas A to D in Figs. 4A to 4C; 
Fig. 9 is a view showing plural add-on lines existing 
in each of the areas A to D in Figs. 4A to 4C; 
Fig. 10 is a detailed view showing two of the plural 
add-on lines in Fig. 9; 

Figs. 11 A and 11 B are detailed views showing a 
case where the two add-on lines in Fig. 10 are ac- 
tually used; and 

Fig. 1 2 is a view showing a concept of the reproduc- 
tion image formed in the present embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Fig. 1 is a block diagram showing an entire image 
process system which is used in the present embodi- 
ment. 

In Fig. 1 , reference numeral 1 denotes a personal 
computer. Reference numeral 2 denotes a color printer 
which outputs image data image-processed by the per- 
sonal computer 1 , as a visible image. Reference numer- 
al 3 denotes a color scanner which reads R (red), G 
(green) and B (blue) components of an original image 
and then outputs color image data to the personal com- 
puter 1. Reference numeral 4 denotes a display which 
displays the image data image-processed by the per- 
sonal computer 1, as the visible image. Reference nu- 
meral 5 denotes a modem which is provided within the 
personal computer 1. The modem 5 can output the im- 
age data image-processed by the personal computer 1 
to a communication line 6 to transmit it to an another 
external apparatus connected on the communication 
line 6. Further, the modem 5 can receive image data 
from the another external apparatus, and output the re- 
ceived image data to the display 4 or the printer 2 to 
output it visibly. 

The above external apparatus may be the image 
process system shown in Fig. 1 , or may be a mere net- 
work printer, a network scanner, a network display or the 
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like. 

The personal computer 1 has a RAM (random-ac- 
cess memory) for storing therein various softwares, and 
a CPU (central processing unit) for actually initializing 
the software to perform controlling of the entire personal 
computer 1, including controlling of the image process. 

It should be noted that the printer 2, the scanner 3 
and the display 4 have been respectively registered as 
devices in an OS (operating system) installed in the per- 
sonal computer 1. Further, as shown in Fig. 1, it is as- 
sumed that the printer 2, the scanner 3 and the display 
4 are connected to the personal computer 1 through 
connection lines capable of managing the image data 
and a control command. 

All of the personal computer 1, the printer 2, the 
scanner 3 and the display 4 are currently in a power-on 
state and in a job-waiting state. 

Hereinafter, it will be explained a series of process- 
es, i.e., (1) the image data is inputted from the scanner 
3, (2) the inputted image data is edited by using the per- 
sonal computer 1 and the display 4, and (3) the edited 
image data is outputted as the image by the printer 2. 

(1) Image Data Input 

A user initializes an commercially available image 
handling application software which has been installed. 
Thus, the scanner 3 is operated through a scanner driv- 
er/OS, and the image data generated by reading the 
original with the scanner 3 is inputted to the personal 
computer 3. 

In case of operating the scanner 3, the scanner driv- 
er confirms whether or not the device (i.e., scanner 3 
(maker: B, type: 456) in this case) connected to the per- 
sonal computer 1 corresponds to the scanner driver, by 
performing negotiation between the personal computer 
1 and the scanner 3 through an interface cable (e.g., 
I EEE 1 284 standard) connecting the personal computer 
1 and the scanner 3 to each other. Concretely the scan- 
ner driver confirms whether or not maker name, device 
name, type and the like stored in a color profile included 
in the scanner driver respectively correspond to maker 
name, device name, type and the like of the device (i. 
e., scanner 3) obtained by the negotiation. 

If the confirmation results "no correspondence", it 
is confirmed that a color characteristic (i.e., correction 
parameter) corresponding to the color profile is different 
from a color characteristic of the scanner 3, whereby 
color matching can not be realized by color correcting 
(described later). Therefore, the scanner driver gives 
the user warning by indicating such a fact, through a GUI 
of the driver. 

The user selects change or no change of the scan- 
ner driver on the basis of this warning displayed on the 
display 4. 

When changing the scanner driver, it is performed 
a process for again confirming the device name and the 
like of the changed driver and the device name and the 



like obtained by the negotiation. 

When not changing the scanner driver irrespective 
of no correspondence between the scanner driver and 
the scanner 3, the scanner driver generates information 
5 representing "no correspondence between scanner 
driver and scanner". This information is used in an add- 
on process (described later). 

On the other hand, if the confirmation results "cor- 
respondence", the scanner driver does not give such the 
10 warning and continues the operation. 

Then, the scanner driver converts the image data 
generated by reading the original, into the image data 
of file format such as TIFF, Flash-Pix or the like, embeds 
an I CC-standard color profile corresponding to the scan- 
ner 3, and stores the color profile in a storage means 
such as a hard disk or the like in the personal computer 
1. 



20 



(2) Image Data Edit 



Subsequently, the user initiates an image edit ap- 
plication software, calls the file formed in the above 
process ( 1 ) from the application, and causes the display 
4 to display the image. 

2S At this time, the color correction process is per- 
formed by using the embeded ICC-standard color profile 
corresponding to the scanner 3 as a source profile and 
the embeded ICC-standard color profile corresponding 
to the display 4 as a destination profile, to perform 

30 matching between a color of the original and a color of 
the displayed image. 

Then, on the basis of the displayed image, the user 
performs the edit to write a message into the image rep- 
resented by the image data in the file, lay out plural du- 

3S plicated images in one file, and the like, so as to change 
the image data. After then, the image data is again 
stored with the same file format. 



40 



(3) Image Data Output 



Further, the user initiates the image edit application 
software used in the image process system (2), calls the 
edited image data in the file, outputs the called image 
data to the printer 2, and causes the printer 2 to visibly 

45 output an image represented by the image data. 

In order to cause the printer 2 to perform the visible 
outputting on the basis of the image edit application soft- 
ware, the image data is outputled to the printer 2 through 
the printer driver/OS to perform the image forming, in 

50 the same manner as in the case where the image han- 
dling application software in the process (1) causes the 
scanner 3 to perform the image data inputting. 

Also, in case of operating the printer 2, the printer 
driver performs the color correcting (i.e., color matching 

55 process) by using the ICC-standard color profile. When 
the image forming is performed by this image process 
system, the color correcting is performed by using the 
color profile of the scanner 3 (having identification 
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number B-456 (maker: B, type: 456)) as the source pro- 
file and the color profile of the printer 2 (having identifi- 
cation number A-123) as the destination profile. 

Further, in the same manner as in case of operating 
the scanner 3, when the printer 2 performs the visible 5 
outputting, it is confirmed whether or not the color profile 
of the printer driver corresponds (or conforms) to the 
maker and type of the printer 2 which is actually con- 
nected to the personal computer 1 . 

In addition to such the color correcting, the printer 10 
driver performs gamma correcting, color adjusting (i.e., 
masking process), UCR (undercolor removal) process, 
changing of resolution, binarizing process or n-value da- 
ta generation process corresponding to a print device (i. 
e., print head such as inkjet head, thermal transfer head is 
or the like) of the printer, and the like, so as to shift or 
change the color as desired by the user. 

Further, in the image process system to which the 
present invention is applied, on the image which was 
formed based on the image data obtained through the 20 
binarizing process or the n-value data generation proc- 
ess, an additional pattern for discriminating the image 
is added on (i.e., add-on) in a conventional known meth- 
od in the state that the pattern is difficult to be perceived 
by the human eyes. The representative method for an 2S 
add-on process will be explained later. 

Subsequently, the software process by the printer 
driver will be explained with reference to Fig. 5. 

In a step S50 of Fig. 5, the color correction process 
(i.e., color matching process) is performed on the basis 30 
of the color profile of the scanner 3 and the color profile 
of the printer 2. 

Subsequently, in a step S51 , the color-corrected im- 
age data is subjected to the masking process. In steps 
S52 and S53, the obtained image data is subjected to 35 
the UCR process and then to the gamma correction 
process, respectively. Further, in a step S54 ; the reso- 
lution changing process is performed according to ne- 
cessity. It should be noted that the resolution changing 
process in the step S54 may be performed before the 40 
processes in the steps S50 to S53 are performed. 

Subsequently, in a step S55, the multivalue color 
image data is subjected to the binarization process or 
the n-value data generation process in correspondence 
with the function of the printer 2. After the processes in 
the steps S50 to S55 terminated, in a step S56, the add- 
on process is performed to add the additional pattern to 
the binary or n-value color image data. 

Such the additional pattern to be added represents 
the maker and type of the scanner 3 which inputted the so 
color image data to be image-formed and the maker and 
type of the printer 2 which actually formed the color im- 
age represented by this color image data, and is being 
stored in each corresponding color profile. 

Fu rther, an additional pattern wh ich is obtained from 55 
the information representing product name, version, key 
ID (i.e., serial number) and the like of the OS (operating 
system) being initialized by the printer driver is also sub- 
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jected to the add-on process. It should be noted that the 
version and the serial number of this OS can be easily 
obtained by using a system function (so-called com- 
mand). 

As explained in the process (1 ), when not changing 
the scanner driver irrespective of no correspondence 
between the scanner driver and the scanner 3, as shown 
in a conceptional view of Fig. 12, the information repre- 
senting u no correspondence between scanner driver 
and scanner" and further discrimination information of 
the selected scanner driver are added on. In Fig. 12, it 
should be noted that actually the information is being 
added on such that this information is difficult to be per- 
ceived by the human eyes. 

In the add-on process, the information represented 
by the additional pattern may be added on in the state 
being difficult to be perceived by the human eyes, after 
such the information was encoded or enciphered. As a 
concrete add-on method, e.g., it is supposed that bit da- 
ta, bar code or the like being the additional pattern is 
once converted into a spatial frequency component by 
orthogonal transformation and then added on. 

A conception in case of performing the add-on proc- 
ess is shown in Figs. 3 and 4A to 4C. 

It is assumed that an image shown in Fig. 3 is the 
original, e.g., a picture which is read by the scanner 3. 
Further, it is assumed that the original is read by the 
scanner 3, the read image is edited by the personal com- 
puter 1 as being displayed on the display 4, and then 
the reproduced image is visibly outputted from the print- 
er 3. 

When the visible output process is performed, the 
OS name, the version and the key ID of the personal 
computer 1 are added on to a lower left area A; the mak- 
er name (or product name) and the type of the printer 2 
are added on to an upper left area B; the maker name 
(or product name) and the type of the scanner 3 are add- 
ed on to an upper right area C; and the maker name (or 
product name) and the type of the display 4 are added 
on to a lower right area D, in the state being difficult to 
be perceived by the human eyes, as shown in the re- 
produced image of Fig. 4A. 

It should be noted that add-on positions are not lim- 
ited to those shown in Fig. 4A and may be appropriately 
designed in accordance with necessity. For example, as 
shown in Fig. 4B, the areas A to D of Fig. 4A may be 
periodically arranged. Further, when the add-on process 
is performed without using the display 4 corresponding 
to the area D, or when such the display 4 does not exist 
in the image process system, the reproduced image has 
the area arrangement shown in Fig. 4C. 

In the image process system, when the image data 
or the image represented by the image data is used for 
some illegal (i.e., prohibited) action, pursuit can be per- 
formed on the basis of the additional pattern added on 
to this image data or this image. 

Further, a condition for the add-on process may be 
changed not only in case of performing the visible output 
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process but also in case of performing the image edit 
process, the image display process or the like. In the 
present embodiment, when the image data is visibly out- 
putted to the printer 2, the add-on process is performed 
in the final step of the image editing. Thus, it can be pre- 
vented that the image is edited and changed after the 
add-on process was performed. 

The color profile used in the present embodiment is 
to correct a color characteristic which is inherent in the 
device (printer 2, scanner 3, display 4 or the like). There- 
fore, the color profile corresponds to each device and is 
generally provided from each device maker. 

Fig. 6 is a view showing a data format of above- 
described color profile. 

In Fig. 6, ID information which represents the mak- 
er, the device name, the type and the like of the device 
corresponding to this color profile is described in an area 
60, version information of the color profile of this device 
is described in an area 61 , and a look-up table is de- 
scribed in an area 62 as a color matching parameter 
used in the color correcting. 

Further, other data is stored in an area 63. For ex- 
ample, an additional pattern or the like which is used to 
add on the maker, the device name, the version and the 
like in the add-on process is described in the area 63. 

In a case where the additional pattern is not de- 
scribed, it is necessary for the OS or the various devices 
themselves to have the function for converting the mak- 
er, the device name, the version and the like into the 
additional pattern. 

In the present embodiment, the example is shown 
in which the ICC-standardcolor profile is used. Howev- 
er, even in case of a dedicated driver not using the ICC- 
standard color profile, similarly, the correspondence or 
matching between the printer driver and the device (i.e., 
printer) may be confirmed by performing the negotiation 
between the personal computer 1 (i.e., host computer) 
and the device. If such the confirmation results no cor- 
respondence between the printer driver and the printer, 
the additional pattern representing "no correspondence 
between printer driver and printer" shown in Fig. 12 is 
added to the color image data. Moreover, the discrimi- 
nation information representing that the printer driver 
corresponding to which device was used is added on. 

As described above, even if the device driver and 
the device are not corresponding to each other, it is at 
least possible that the serial number of the OS is added 
on. 

(Example of Add-On Process) 

Hereinafter, one example of the concrete add-on 
process in the present embodiment will be explained. 

It is assumed that the following example is directed 
to the case where the multivalue data generating (eight- 
bit data generating on each color = 256 gradation gen- 
erating) is performed because the printer to be used is 
a multivalue printer in the step S55 of Fig. 5, i.e., the 



10 

add-on process in the step S56 is performed on the mul- 
tivalue color image data. 

It should be noted that the add-on process is per- 
formed on each color component of the color image data 

5 (i.e., C (cyan), M (magenta), Y (yellow) and K (black) 
components converted from R, G and B components in 
the steps S51 and S52). In the present embodiment, it 
is assumed that the add-on process is performed only 
on the Y component, and thus such a case will be ex- 

10 plained. 

It is further assumed that each of the areas A to D 
in Figs. 4A to 4C is considered as a unit image, and the 
add-on process is performed on this unit image. 

In Fig. 7,4X4 pixels represented by an area 301 

15 are the part of each of the areas A to D of the multivalue 
color image data which has been processed until the 
step S55 by the printer driver in the personal computer 1 . 

The color image data is modulated such that the 
gradation of these 4X4 pixels increases by a. Then, in 

20 accordance with this, the color image data is modulated 
such that the gradation of areas 302 and 303 decreases 
by a. It should be noted that the total number of the pix- 
els of the areas 302 and 303 is the same as that of the 
area 301 . Other areas in Fig. 7 are not modulated. The 

25 8X4 pixels of the areas 301 to 303 are considered as 
a unit dot of the additional pattern. According to such 
the modulation processes, since a density (i.e., grada- 
tion) of the image itself does not change, the pattern 
which is difficult to be perceived by the human eyes can 

30 be added on. 

Figs. 8 and 9 are views showing examples of add- 
on lines which are provided in the area (each of areas 
A to D) represented by the color image data. 

In Fig. 8, reference numeral 401 denotes the add- 

35 on line which has a four-pixel width. Reference numer- 
als 401a to 401 e denote the unit dots shown in Fig. 7 
each having the 8 x 4 pixels. The unit dots 401 a to 401 e 
are arranged at a predetermined period dl (e.g. , 1 28 pix- 
els) in the main-scan direction. 

40 Further, in Fig. 9, reference numerals 501 to 510 
denote the add-on lines which are arranged at a prede- 
termined period d2 (e.g., 16 pixels) in the sub-scan di- 
rection. Although the details will be described later, e. 
g., since one add-on line can represent the tour-bit in- 

45 formation, the eight add-on lines 502 to 509 (as eight- 
tuple) can represent the 32-btt additional information. It 
should be noted that the add-on tines 501 to 509 repre- 
sent the same information. 

Fig. 10 and Figs. 11 A and 11 B are views showing 

so howto express the information (maker and type of scan- 
ner 3 and printer 2; product name, version, key ID (serial 
number) of OS; and the like) by the add-on line. 

In Fig. 10, reference numerals 501 and 502 denote 
the add-on lines shown in Fig. 9. These lines are adja- 

55 cent to each other in the sub-scan direction. Reference 
numerals 501a, 501b (in upper add-on line 501) and 
502a (in lower add-on line 502) are unit dots. In the up- 
per and lower adjacent lines 501 and 502, each unit dot 
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is apart from others by at least a distance d3 (e.g., 32 
pixels) in the main-scan direction, in order to prevent 
inconvenience that the unit dots in the upper and lower 
add-on lines 501 and 502 are close to others in the main- 
scan direction (i.e., upper-line unit dot is arranged in par- 
allel with lower-line unit dot) and thus these dots become 
remarkable for the human eyes. 

The data represented by the unit dot is determined 
by a phase difference between the unit dots 501a and 
502a in the main-scan direction. That is, when the lower- 
line unit dot 502a is added to a position ,, 2" in positions 
"0" to "F", such the unit dot 502a represents data "2". 

In other words, data u 0 n to "F u can be expressed by 
a phase aberration amount in the main-scan direction 
of the upper and lower adjacent add-on lines. 

In Figs. 11 A and 11B, reference numeral 501 and 
502 denote the add-on lines shown in Fig. 9. In the add- 
on line 502, unit dots 74a to 74d are added respectively 
to the right sides of the unit dots 501a to 501 d of the 
additional patterns which represent the information es- 
sentially intended to be added, at a distance d4 (e.g., 
1 6 pixels). Similarly, in the add-on line 502, unit dots 75a 
to 75d are added respectively to the right sides of unit 
dots 502a to 502d of the additional patterns which rep- 
resent the information essentially intended to be added, 
at a distance d5. Such the additional dot acts as a mark- 
er for clarifying that each add-on line is which one from 
the top. Since the markers are to decide the uppermost 
and lowermost lines in the sub-scan direction from the 
visibly outputted image, it is enough to add the markers 
to the two add-on lines. 

Since the above add-on process is performed on 
the Y component in the Y, M, C and K components, it is 
difficult for the human eyes to discriminate it. 

In the above add-on process, the various informa- 
tion to be added is made as the additional pattern 
formed by the dots. The add-on process is not limited to 
this method. That is, an actual character (i.e., maker 
name or the like) may be added to the Y component of 
the C, M, Y and K components which form each of the 
areas A to D of the reproduced image shown in Figs. 4A 
to 4C. 

Further, it is described in the present embodiment 
the case where the color image data is visibly outputted 
by the printer 2. However, the present invention is not 
limited to this case, and can be applied to suppress or 
restrain division of the color image data. In such a case, 
since the various information may not be discriminated 
from the visibly outputted image, e.g., when the multi- 
value image data is managed, a bit plane of lower one 
bit may be replaced by a bit plane in which the various 
information is represented as the binary image. By such 
a method, quality of the color image data itself is hardly 
deteriorated. 

The above add-on process is the add-on process 
to the multivalue image data. However, even in case of 
performing the add-on process to the binary image data, 
the add-on process can be performed on the bit plane 



of the Y component in the known method of, e.g. , shifting 
the dot positions in each line of the image, in the same 
manner as that for the multivalue image data. 

When the personal computer 1 has a network board 
s instead of the modem 5, the personal computer 1 is con- 
nected to the network and thus can perform the image 
data communicating. Further, in the modem 5 or the net- 
work board, an inherent number of the modem 5 or the 
network board can be added to the image represented 
10 by the color image data, in the same manner as that for 
the other apparatus. Therefore, for example, when the 
color image data inputted from the scanner 3 is trans- 
mitted to other external apparatuses through the net- 
work, the inherent discrimination information concern- 
's ing the scanner 3, the personal computer 1 and the net- 
work board is surely added to the color image data to 
be transmitted. 

Further, in the present embodiment, in the case 
where the color image data is transmitted to the other 
20 external apparatus through the network, when such the 
color image data is made to have the file format in which 
the color profiled can be embedded, the color profile cor- 
responding to the various apparatuses are transferred 
to the other external apparatus together with the color 
25 image data. Therefore, the apparatus which received 
the color image data can add the inherent discrimination 
information concerning the scanner 3, the display 4 and 
the like to the color image data as the additional pattern 
on the basis of the received color profile. 
30 in the present embodiment, when the color image 
data to which the color profile was added is outputted to 
the printer 2, the discrimination information concerning 
the OS : the printer 2, the scanner 3 and the display 4 is 
added on to the color image data inputted from the scan- 
35 ner 3. However, in order to prevent the inconvenience 
that the color image data is unfairly or illegally used be- 
fore it is outputted to the printer 2, the inherent discrim- 
ination information of the scanner 3 stored in the OS or 
the scanner driver is added to the color image data as 
40 the additional pattern as soon as the color image data 
is inputted from the scanner 3, whereby the discrimina- 
tion information can be surely added on. 

Similarly, for all the apparatuses, the discrimination 
information of each apparatus is added on as the addi- 
45 tional pattern whenever each apparatus processes the 
color image data, whereby the discrimination informa- 
tion can be surely added on. 

In this case, since it is difficult for the printer driver 
to perform the add-on process, each device driver for 
50 operating each device may add on the discrimination in- 
formation of the OS, the printer 2, the scanner 3 and the 
display 4. 

In another method, the OS of the personal computer 
1 may control the add-on process of each device. More- 
55 over, the OS of the personal computer 1 may confirm 
the connected devices which are usually confirmed by 
each device driver. 

It should be noted that the present invention in- 
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eludes a case where another input apparatus (digital 
camera, video camera or the like) for inputting the color 
image data is used instead of the scanner 3. In this case, 
the information concerning maker and type of such the 
input apparatus is added on to the area C shown in Figs. 
4A to 4C. 

The present invention is not limited to the appara- 
tuses and the methods for realizing the above-described 
embodiment. That is, the invention employed by a meth- 
od whereby program codes of a software to realize the 
functions of the above-described embodiment are sup- 
plied to a computer in an apparatus or a system con- 
nected to various devices so as to make the devices op- 
erative in order to realize the functions of the above-de- 
scribed embodiment and the various devices are oper- 
ated in accordance with the programs stored in the com- 
puter (CPU or MPU) of the system or apparatus is also 
included in the scope of the present invention. 

In such a case, the program codes themselves of 
the software realize the functions of the above-de- 
scribed embodiment and the program codes them- 
selves and means for supplying the program codes to 
the computer, e.g., a storage medium in which the pro- 
gram codes have been stored, construct the present in- 
vention. 

As such the memory medium to store the program 
codes, e.g., it is possible to use a floppy disk, a hard 
disk, an optical disk, an optomagnetic disk, a CD-ROM, 
a magnetic tape, a nonvolatile memory card, a ROM or 
the like can be used. 

It will be obviously understood that the program 
codes are included in the embodiment of the present 
invention even in not only a case where the functions of 
the above-described embodiment are realized by exe- 
cuting the supplied program codes with the computer 
but also a case where the functions of the above-de- 
scribed embodiment are realized in cooperation with the 
OS by which the program codes operate in the computer 
or another application software or the like. 

Further, it will be also obviously understood that the 
present invention also incorporates a case where the 
supplied program codes are stored into a memory pro- 
vided in a function expansion board of the computer or 
a function expansion unit connected to the computer 
and, after that, the CPU or the like provided in the func- 
tion expansion board or the function expansion unit ex- 
ecutes a part or all of the actual processes on the basis 
of instructions of the program codes, and the functions 
of the above-described embodiment are realized by the 
processes. 

According to the above-described embodiments of 
the present invention, when the image data is managed 
among the plural image processing apparatuses, it can 
be suppressed or restrained as much as possible that 
such the image data is illegally or unfairly used. Further, 
in addition to the conventional additional information, 
the further effective additional information can be added 
in the state difficult to be perceived by the human eyes. 



Concretely, when the image data representing the 
image is outputted to the external apparatus, it can be 
suppressed that such the image data is illegally or un- 
fairly used. Further, when the image data is inputted 
s from the image pickup apparatus capable of reading the 
image and generating the image data, it can be sup- 
pressed that such the image data is illegally or unfairly 
used. 

Furthermore, on the input image data, the conven- 
io tional information for identifying the apparatus itself is 
not added but the another additional information is add- 
ed, whereby the illegal or unfair use of the image data 
can be suppressed more effectively. 

Although the present invention has been described 
is above with respect to the preferred embodiments, the 
present invention is not limited to the above-described 
embodiment but many modifications and variations are 
possible with the spirit and scope of the appended 
claims. 

20 

Claims 

1 . An image processing apparatus which is connected 
25 to an external apparatus being an output destina- 
tion of image data, said image processing appara- 
tus comprising: 

input means for inputting the image data repre- 

30 senting an image; 

addition means for adding additional informa- 
tion capable of specifying the external appara- 
tus to the image data inputted by said input 
means, in a state that the additional information 

35 js difficult to be perceived by human eyes; and 

output means for outputting the image data to 
which the additional information was added by 
said addition means, to the external apparatus. 

40 2. An apparatus according to Claim 1 , wherein the im- 
age data is color image data composed of a plurality 
of color components, and said addition means adds 
the additional information not to all of the plurality 
of color components but to the part of the color com- 

45 ponents. 

3. An apparatus according to Claim 2, wherein the part 
of the color components is an yellow component. 

so 4. An apparatus according to Claim 1 , wherein said 
image processing apparatus is further connected to 
a second external apparatus which is different from 
the external apparatus and supplies the image data 
to said input means, and said addition means adds 

55 to the image data inputted by said input means the 
additional information capable of specifying the ex- 
ternal apparatus and the second external apparatus 
such that the additional information is difficult to be 
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perceived by the human eyes. said addition step, to the external apparatus. 



5. An apparatus according to Claim 1, wherein said 
image processing apparatus is further connected to 
an image display apparatus, and said addition 
means adds to the image data inputted by said input 
means the additional information capable of speci- 
fying the image display apparatus such that the ad- 
ditional information is difficult to be perceived by the 
human eyes. 

6. An apparatus according to Claim 1 , further compris- 
ing discrimination means for discriminating a fea- 
ture of the external apparatus, and wherein said ad- 
dition means adds the additional information on the 
basis of a discriminated result by said discriminating 
means. 

7. An apparatus according to Claim 6, wherein, when 
said discrimination means can not discriminate the 
feature of the external apparatus, said addition 
means adds the additional information representing 
that the discriminating of the external apparatus is 
impossible. 



12. A control method of an image processing apparatus 
which is connected to an external apparatus being 
an output destination of image data, said method 
comprising: 

an input step of inputting the image data repre- 
senting an image; 

an addition step of adding additional informa- 
tion capable of specifying the external appara- 
tus to the image data inputted in said input step, 
in a state that the additional information is diffi- 
cult to be perceived by human eyes; and 
an output step of outputting the image data to 
which the additional information was added in 



1 3. A storage medium wh ich stores, in a compute r read- 
able state, a control program of an image process- 
s ing apparatus connected to an external apparatus 

being an output destination of image data, said con- 
trol program comprising: 

an input step of inputting the image data repre- 
10 senting an image; 

an addition step of adding additional informa- 
tion capable of specifying the external appara- 
tus to the image data inputted in said input step, 
in a state that the additional information is diffi- 
is cult to be perceived by human eyes; and 

an output step of outputting the image data to 
which the additional information was added in 
said addition step, to the external apparatus. 

20 14. An image processing apparatus which is connected 
to an image pickup apparatus for generating image 
data by reading an image, said image processing 
apparatus comprising: 

input means for inputting the image data from 
the image pickup apparatus; 
addition means for adding additional informa- 
tion capable of specifying the image pickup ap- 
paratus to the image data inputted by said input 
means, in a state that the additional information 
is difficult to be perceived by human eyes; and 
output means for outputting the image data to 
which the additional information was added by 
said addition means. 

15. An apparatus according to Claim 14, wherein the 
image data is color image data composed of a plu- 
rality of color components, and said addition means 
adds the additional information not to all of the plu- 
rality of color components but to the part of the color 
components. 

16. An apparatus according to Claim 15, wherein the 
part of the color components is an yellow compo- 

4S nent. 

17. A control method of an image processing apparatus 
which is connected to an image pickup apparatus 
for generating image data by reading an image, said 

so method comprising: 

an input step of inputting the image data from 
the image pickup apparatus; 
an addition step of adding additional informa- 
55 tion capable of specifying the image pickup ap- 

paratus to the image data inputted in said input 
step, in a state that the additional information 
is difficult to be perceived by human eyes: and 



is 



25 

8. An apparatus according to Claim 6, wherein said 
discrimination means performs the discriminating 
on the basis of a result of negotiation between the 
external apparatus and said image processing ap- 
paratus. 30 

9. An apparatus according to Claim 1, wherein said 
image processing apparatus includes a personal 
computer. 

35 

10. An apparatus according to Claim 1 , wherein the ex- 
ternal apparatus includes an image formation ap- 
paratus which prints and outputs the image. 

11. An apparatus according to Claim 4, wherein the 40 
second external apparatus is an image read appa- 
ratus which generates the image data by reading 
an original. 
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an output step of outputting the image data to 
which the additional information was added in 
said addition step. 

18. A storage medium which stores, in a computer read- 
able state, a control program of an image process- 
ing apparatus which is connected to an image pick- 
up apparatus for generating image data by reading 
an image, said control program comprising: 

an input step of inputting the image data from 
the image pickup apparatus; 
an addition step of adding additional informa- 
tion capable of specifying the image pickup ap- 
paratus to the image data inputted in said input 
step, in a state that the additional information 
is difficult to be perceived by human eyes; and 
an output step of outputting the image data to 
which the additional information was added in 
said addition step. 

19. An image processing apparatus which operates by 
using a predetermined software, comprising: 

input means for inputting image data represent- 
ing an image; 

addition means for adding additional informa- 
tion capable of specifying the predetermined 
software to the image data inputted by said in- 
put means, in a state that the additional infor- 
mation is difficult to be perceived by human 
eyes; and 

output means for outputting the image data to 
which the additional information was added by 
said addition means. 

20. An apparatus according to Claim 1 9 L wherein the 
predetermined software is an OS (operating sys- 
tem) software. 

21. An apparatus according to Claim 19 : wherein the 
additional information is information representing a 
version of the predetermined software. 

22. An apparatus according to Claim 1 9 : wherein the 
additional information is a serial number of the pre- 
determined software. 

23. An apparatus according to Claim 19, wherein the 
additional information is information representing a 
product name of the predetermined software. 

24. A control method of an image processing apparatus 
which operates by using a predetermined software, 
said method comprising: 

an input step of inputting image data represent- 
ing an image; 
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an addition step of adding additional informa- 
tion capable of specifying the predetermined 
software to the image data inputted in said input 
step, in a state that the additional information 
is difficult to be perceived by human eyes; and 
an output step of outputting the image data to 
which the additional information was added in 
said addition step. 

25. A storage medium which stores, in a computer read- 
able state, a control program of an image process- 
ing apparatus which operates by using a predeter- 
mined software, said control program comprising: 

an input step of inputting image data represent- 
ing an image; 

an addition step of adding additional informa- 
tion capable of specifying the predetermined 
software to the image data inputted in said input 
step, in a state that the additional information 
is difficult to be perceived by human eyes; and 
an output step of outputting the image data to 
which the additional information was added in 
said addition step. 

26. An image processing apparatus which is connected 
to an external apparatus, said image processing ap- 
paratus comprising: 

input means for inputting image data; 
color process means for performing a color 
process on the image data inputted by said in- 
put means, in a method suitable for the external 
apparatus; 

addition means for adding a code specifying the 
method of the color process to the image data, 
in a state that the code is difficult to be per- 
ceived by human eyes; and 
output means for outputting the image data to 
which the code was added by said addition 
means. 



27. An apparatus according to Claim 26, wherein the 
code represents information which can specify a 

45 color profile used in the color process. 

28. An apparatus according to Claim 26, wherein the 
code represents information which can specify the 
external apparatus. 



50 



55 



29. A control method of an image processing apparatus 
which is connected to an external apparatus, said 
method comprising: 

an input step of inputting image data; 
a color process step of performing a color proc- 
ess on the image data inputted in said input 
step, in a method suitable for the external ap- 
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paratus; 

an addition step of adding a code specifying the 
method of the color process to the image data, 
in a state that the code is difficult to be per- 
ceived by human eyes; and 
an output step of outputting the image data to 
which the code was added in said addition step. 

30. A storage medium which stores, in a computer read- 
able state, a control program of an image process- 
ing apparatus which is connected to an external ap- 
paratus, said control program comprising: 
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connection means for connecting the appara- 
tus to an apparatus operable to generate image 
data; and 

means for adding information to the image data 
conveying the identification of the image data 
generating apparatus in a form such that, when 
the image data is displayed/printed as an im- 
age, the identification information is difficult to 
see with the naked human eye. 



31. 



an input step of inputting image data; 
a color process step of performing a color proc- 
ess on the image data inputted in said input 
step, in a method suitable for the external ap- 
paratus; 

an addition step of adding a code specifying the 
method of the color process to the image data, 
in a state that the code is difficult to be per- 
ceived by human eyes; and 
an output step of outputting the image data to 
which the code was added in said addition step. 

An image processing apparatus or method in which 
identification information is added to image data in 
a form such that, when the image data is printed or 
displayed as an image, the identification informa- 
tion is difficult to see with the naked human eye, the 
identification information conveying the identifica- 
tion of at least one of : 
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20 



25 



30 



an external apparatus which is the output des- 
tination of the image data; 35 
an external apparatus which has generated the 
image data; 

predetermined software used by the image 
processing apparatus; and 

a method of processing the image data per- 40 
formed by the image processing apparatus. 

32. An image processing apparatus for processing im- 
age data, comprising: 

45 

connection means for connecting the appara- 
tus to an external apparatus and for outputting 
processed image data thereto; and 
means for adding information to the image data 
conveying the identification of the external ap- so 
paratus in a form such that, when the image da- 
ta is displayed/printed as an image by the ex- 
ternal device, the identification information is 
difficult to see with the naked human eye. 

55 

33. An image processing apparatus for processing im- 
age data, comprising: 
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